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^sj I Abstract 

^^1 Game theory is usually considered applied mathematics, but a few game-theoretic results, 

C^ . such as Borel determinacy, were developed by mathematicians for mathematics in a broad 

sense. These results usually state determinacy, i.e. the existence of a winning strategy in 

games that involve two players and two outcomes saying who wins. In a multi-outcome setting, 

^^3 ' the notion of winning strategy is irrelevant yet faithfully replaced with the notion of (pure) 

O^ ' Nash equilibrium. This article shows that every determinacy result over a game structure, 

e.g. a tree, is transferable into existence of multi-outcome (pure) Nash equilibrium over the 

same game structure. The equilibrium-transfer theorem requires cardinal and order-theoretic 

conditions on the strategies and the preferences respectively, whereas counter-examples show 

1—^ , that every requirement is important, including the players being two only. As examples of 

(-H ' application, this article generalises (by invoking!) Borel determinacy, positional determinacy 

of parity games, and finite-memory determinacy of Miiller games. 
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Game theory is the theory of competitive interactions between decision makers having different 
interests. Its primary purpose is to further understand such real-world interactions through math- 
ematical modelling. Apart from some earlier related works, the field of game theory is usually 
f—^ I said to be born in the first part of the 20th century, especially thanks to von Neumann [11] , but 

psj ■ also Borel [T] and some others. Since then, it has been applied to many areas such as economics, 

political science, evolutionary biology, etc. Conversely, specific problems in these areas have been 
raising new questions and have thus been helpful in developing game theory. 
. . , Game theory has also provided a useful point of view for abstract areas such as descriptive set 

r> ' theory and theoretical informatics. In the games that are usually involved therein, two players play 

jrt ! alternately and infinitely often, and only then one player eventually wins, whereas the opponent 

■ ■ ■ loses. For instance, Martin's Theorem on Borel determinacy [7], [5] (generalising [3] and [13]) relates 

Borel sets to the existence of winning strategies in such games built on infinite trees; similarly, 
some program- verification results, such as [5] or [i] (generalising [5] and [5]), relate specific logical 
properties to the existence/computation of simple winning strategies in such games built on graphs. 
In such frameworks, existence of a winning strategy (of some sort) is called determinacy, and the 
games that enjoy it are said to be determined. 

Game theory also studies games with many players and many possible outcomes, where it is no 
longer a mere matter of winning instead of losing, but each agent has (complex) preferences over 
the possible outcomes instead. There, the notion of winning strategy is irrelevant yet faithfully 
replaced with the notion of (pure, not mixed) Nash equilibrium, introduced in [lOj . This multi- 
outcome framework should not only constitute a more accurate modelling tool, but also trigger 



phenomena (involving Nash equihbrium) that cannot occur in the two-outcome framework. On 
the contrary, this article essentially shows that determinacy (over a two-player game structure 
instantiated with two outcomes) is equivalent to existence of Nash equilibrium (over the same 
game structure instantiated with many outcomes). It actually shows more than this under some 
weak conditions that are detailed in the remainder of the introduction. This equilibrium-transfer 
theorem will be proved for games in normal form, i. e. a class of games where many other classes 
of games can be faithfully embedded as far as Nash equilibrium is concerned. 

Unlike traditional games in normal form, the definition below involves abstract outcomes (in- 
stead of mere real- valued payoff functions) and preferences that are arbitrary (instead of transitive, 
reflexive, total, etc.). It is important since there is no reason why games, e.^., with real-valued 
payoff functions should account for all possible games, as shown in Section [5] 

Definition 1 (Games in normal form) Such a game is an object (A, ^ag^^S'a, O, u, (-<a)aeyi) 

complying with the following: 

• A is a non-empty set (of players), 

®aeASa is a non-empty Cartesian product (whose elements are the strategy profiles and where 
Sa represents the strategies available to player a), 



• 



• 



O is a non-empty set (of possible outcomes), 

• V : (!S)aeASa -^ O (uses the outcomes to value the strategy profiles), 

• Each -<a is a binary relation over O (modelling the preference of player a). 

The traditional notion of Nash equilibrium is rephrased below in the abstract setting with a 
subtle semantic change (but remains the same in extension): each binary relation -<a, which I call 
preference, is the complement of the inverse of what is traditionally called preference. 

Definition 2 (Nash equilibrium) Let g — (A, (Sag^S'a, O, u, (-<a)aeA) be a game in normal 
form. A strategy profile s in S :~ ®a£ASa is a Nash equilibrium if it makes every agent a stable, 
i.e. v{s) y^a w(s') for all s' £ S that differ from s at most at the a-component. 

NE{s) := Va e A,\fs' e S, -^{v{s) -ia v{s') A V6 £ A - {a}, Sf, = 4) 

Proposition [3] below is a very simple version of the equilibrium-transfer theorem, but the very 
basic idea is already there. It uses only an abstraction of zero-sum games, i.e. two-player games 
where preferences are inverses of each other. It is named after von Neumann's Minimax Theorem 
(see, e.g., [TT]) to hint at the similarities, although it is neither a generalisation nor a special 
case of it. (For instance, the Minimax Theorem involves infinitely many mixed strategies whereas 
Proposition [3] involves finitely many pure strategies only.) Note that v{si,S2) below refers to 

{v{si,S2) I S2 e S2}. 

Proposition 3 (Minimax transfer) Let ({1,2}, 5*1 x 5*2, O, w, <i, <2) be a two-player game in 
normal form and let us assume the following: 

1. <2=<]^ is a strict linear order over the finite domain O. 

2. VP C O, (Va; E PVy eO,x <iy^y G P) 

^ (3si e 5i, w(si, ^2) c P) V (3s2 e ^2, v{Si,s2) c 0\P) 

Informally, for every <i-terminal interval of outcomes, either player 1 can enforce it or 

player 2 can exclude it. 



Then the game ({l,2},5i x 5*2, O, w, <i, <2) has a Nash equilibrium and all Nash equilibria yield 
the same outcome. 

Proof Let P be the smallest <i-tcrminal (or <i-upper) interval that player 1 can enforce via 
some strategy si, and let m be the <i-minimum (and the <2-maximum!) of P. Since player 1 
cannot enforce P — {m}, player 2 can enforce {0\P) Li {m} via some strategy S2- Therefore (si,S2) 
is a Nash equilibrium yielding outcome m, and any strategy profile that does not yield m may be 
improved upon by some player i via Si. D 

The equilibrium-transfer theorem is now stated in its most useful form, when considering a 
multi-outcome two-player game and a predicate on its strategies: If arbitrarily mapping the out- 
comes to {win, lose} (or equivalently to {(1, 0), (0, 1)}) yields a game with a winning strategy that 
satisfies the predicate, the original game has a Nash equilibrium whose two components satisfy the 
predicate, provided that either the heights of the preferences are finite {i.e. there exists a finite 
bound to the length of all chains of the preferences) , or the inverse relations of the preferences are 
well-founded and if one player has uncountably many strategies, the opponent has finitely many 
strategies. 

This result may be interpreted from different points of view. Game theorist: to prove existence 
of Nash equilibrium for a large class of games, I may just prove existence of Nash equilibrium 
(or equivalently of winning strategy) for the subclass involving two outcomes only. Logician: my 
determinacy result, which was meant for logic only, can be extended to a wider Nash-equilibrium 
result that may interest game theorists, provided that I define a multi-outcome version of my 
games. Lazy mathematician: I might generalise existing determinacy results for free, without 
knowing how they are proved or even what they mean! Computer scientist: since I consider only 
computable strategies, which are countably many, I can extend my determinacy result to infinite- 
height preferences; moreover, if there is always a winning strategy that is easy to compute, there 
is always a Nash equilibrium that is easy to compute; even uniformly when outcomes a finitely 
many, as discussed later. 

All the conditions of application of the equilibrium-transfer theorem are useful: First, when the 
inverse of some preference is not well-founded, it is easy to build a game without Nash equilibrium. 
Second, this article defines a game such that the strategies of one player only are countably many, 
one preference only has finite height and the inverse of the other preference is still well-founded, but 
there is no Nash equilibrium although arbitrarily rewriting the outcomes with win and lose yields 
a determined game. Third, there is no obvious three-player version of the equilibrium-transfer 
theorem: indeed, for every natural n, there exists a finite three-player game with preferences of 
heights n -f 1 and without Nash equilibrium, although arbitrarily replacing the preferences with 
preferences of height at most n yields a game with Nash equilibrium. (Of course, it does not mean 
that the conditions of application of the theorem cannot be effectively weakened for specific classes 
of games though.) 

Note that, in the area of graph games for program verification, P^ has already investigated 
extensions of determinacy in various directions, namely for subgame perfect equilibrium (a stronger 
notion of Nash equilibrium), for n-player games instead of two- player games, or for payoff functions 
in {0, 1}" instead of {(0, 1), (1, 0)}. For instance. Theorem 4.19. in [T^ states that any initialised 
two-player parity game has a positional subgame perfect equilibrium and Theorem 4.20. states 
that any initialised finite multiplayer parity game has a finite-state subgame perfect equilibrium. 

Section [2] presents the equilibrium-transfer theorem and a basic algorithmic remark; Section |3] 
invokes the equilibrium-transfer theorem to generalise Martin's theorem on Borel determinacy, 
positional determinacy of parity games (with infinitely many priorities), and finite-memory deter- 
minacy of Miiller games; Section 2] gives counterexamples to reasonable candidates to generalise 
the theorem; and Section [5] concludes and shows in passing that linearly ordered preferences do 
not account for partially ordered preferences. 



2 The equilibrium-transfer theorem 

This section proves the theorem by transfinite induction on the preferences. The three main 
ingredients of the proof are: an equihbrium-reflecting reduction that shrinks games in terms of 
preferences, a property on functions from N^ to N that enables a diagonal argument when shrinking 
games is not possible, and a finite-case version of the theorem, which itself relies on lifting binary 
relations to the power set of their domains. This lift, defined below, is the basic idea of the 
equilibrium transfer: especially, it overcomes the difficulty that the proof of the minimax transfer 
does not scale up for preferences that are not inverses of each other. 

Definition 4 A binary relation -< on a set S may be lifted to the power set of S as below. 

yA,BCS, A^'^ B ■.= 3aeA\B,\/beB\A,a-^b 

Lemma 5 Let -< be a binary relation on a set S . If < is a strict linear order, -<^ is a strict 
partial order. 

Proof A strict partial order is a transitive and irreflexive binary relation. A strict linear order 
is a strict partial order such that any two distinct elements are comparable. Assume that -< is as 
strict linear order. Since -<'^ is irreflexive by definition, it suffices to show that '<'^ is transitive. 
Assume that A -<'^ B and B '<'^ C with respective witnesses a G A\B and b G B\C. First note 
that a 7^ 6 since a ^ B and b E B. Now let us case-split to show that A -<'^ C. 

• Assume that a ^ 6, so -i(6 -< a) by transitivity and irrefiexivity assumptions, so a ^ C\B 
since 6 is a witness for B ^^ C. Together with a ^ i? it yields a ^ C, so a E A\C. Now 
let X be in C\A. li x <E B, then x G B\A, and a ^ x since a is a witness for A -<^ B. If 
X ^ B, then x G C\B, and b < x since 6 is a witness for B -<^ C ^ so a < x hy transitivity. 
Therefore ^ ^'^ C is witnessed by a. 

• Assume that 6 ^ a, so ^(a -< b) by transitivity and irrefiexivity assumptions, so 6 ^ B\A 
since a is a witness for A -(^ B. Together with 6 G S it yields 6 G A, so 6 G A\C . Now let 
X be in C\A. li x ^ B, then x G C\B, and b -< x since 6 is a witness for B -<^ C. If x G B, 
then X G B\A, and a ^ x since a is a witness for A -<^ B,soh ^ xhj transitivity. Therefore 
A -<^ C is witnessed by b. 

n 

The lemma below states a bit more than a mere finitely-many-outcome version of the forth- 
coming theorem; it sounds a bit less natural too, due to Condition [3] (which is obviously fulfilled 
when the outcomes are finitely many), but it is very useful in the proof of the theorem. Note that 
Condition [U where w(si,S'2) refers to {w(si,S2) | S2 G 'S'2}, amounts to determinacy of any two- 
outcome version of the original game where the winning strategies must satisfy some additional 
predicate. Also note that Condition [T] defines the notions of enforcement and exclusion. 

Lemma 6 (Finitary equilibrium transfer) Let ({l,2},5i x S'2, O, w, ^1, ^2) be a two-player 
game in normal form, let Ri C Si and R2 Q S2, and let us assume the following: 

1. VP C O, (3si G i?i, v{.si,S2) C P) V (3s2 G P2, v{Si,.S2) C 0\P) 

That is, for every subset of outcomes, either player 1 can enforce it via some strategy in Ri 
or player 2 can exclude it via some strategy in i?2- 

2. Both preferences ~<i and -<2 are acyclic. 

3. 3si G Si, |{o G O I 3s2 G S'2, ^(51,52) ^1 o}| < 00 V 
3s2 e S2, \{o eO I 3si G Si, w(si, S2) <2 o}\ < 00 

That is, player i can enforce a subset of outcomes whose -<i-upper cone is finite. 



Then the game ({1,2}, 5*1 x iS'2, 0,"^, ^i, ^2) has a Nash equilibrium in Ri x i?2- 
Proof First note that if one player i can enforce a subset of outcome {via some strategy in 
Si), he/she can enforce it via some strategy in Ri, since the opponent cannot exclude it and by 
assumption (2). Assume that one player, e.g., player 1 can enforce C a finite -<i-upper cone. Since 
^1 is acyclic, so is its restriction ^ijc to C; let < be a strict linear extension of -<i|c, so <^ is a 
strict partial order by lemma [5] (Actually a strict linear order but this fact is not needed here.) 
Since C is finite, so is V{C), so let M be a <^-maximal (actually the <'''-greatest) subset of C 
that player 1 can enforce and let si G i?i be a strategy enforcing M . 

Since M is finite and non-empty and since ^2 is acyclic, let m be ^2 |M-maximal and let 
X -.^ {x ^ M I x < m} U {x e C I m < x]. Since M <'^ X by definition H] and since A" C C by 
definition of M and X, player 1 cannot enforce X by definition of M, so player 2 can enforce 0\A 
by assumption. Let S2 G i?2 be a strategy enforcing 0\X, so that w(si, S2) G M n (0\A) — {to}. 

Player 2 is stable since m is ^2-maximal in M enforced by si. Let o E O such that m -<i o, so 
o £ C be definition of C, so o G A by definition of X. Therefore m is ^i-maximal among 0\X 
enforced by 2. Therefore the strategy profile (si, S2) G i?i x i?2 is a Nash equilibrium. D 

There is a straightforward algorithmic consequence of the proof of Lemma IHl Namely, finding a 
suitable Nash equilibrium in a two-player game that involves n outcomes requires at most n (resp. 
2) calls to the function Wa (resp. Ws) expecting a two-outcome two-player game and returning the 
winning player (resp. a suitable winning strategy). Indeed, let us first call Wa to check whether 
player 1 can exclude his/her least-preferred outcome. If yes (resp. no), from now on let us only 
consider subsets of outcomes excluding (resp. including) the least-preferred outcome of player 
1. Then let us call Wa and check whether player 1 can exclude his/her second-least-preferred 
outcome, and so on. This procedure calls Wa at most n times to determine the <^-greatest subset 
of outcomes that player 1 can enforce. Then let us call Wg once to determine a strategy of player 1 
that enforces this set, and once to determine a strategy of player 2 that excludes the <2'-successor 
of the <^-greatest subset. 

When considering infinitely many outcomes, there may not exist a maximal subset that a given 
agent can enforce. Nonetheless, the lemma above and the following two lemmas will be combined 
several times to prove the theorem by transfinite induction on (the order types of the inverses of) 
the preferences. 

Lemma [7] below relies on the remark that if an agent can exclude a lower/downward interval 
of least-preferred outcomes, no Nash equilibrium will ever yield such outcomes. So, the exclud- 
able least-preferred outcomes may just be merged into one single worst outcome of the agent, and 
become the best outcome of the opponent: indeed, this reduction does not create any Nash equi- 
librium but yields in many cases a smaller game in terms of outcomes and especially of preferences, 
thus enabling a step in the transfinite induction. Lemma [7] is named after the well-known elimi- 
nation of dominated strategies (see, e.g., [5]), which simplifies a game through its set of strategies 
only, in order to suggest that both procedures may complement each other nicely. (Although not 
in this article.) 

Lemma 7 (Elimination of dominated outcomes) Let g — ({1, 2}, Si x ^2, O, v, <i, <2) be a 
two-player game in normal form with strict linear preferences. Let e E Si and o E O and assume 
that <i v{e, S2) for all S2 G 6*2. Let g' := ({1, 2}, Si x 5*2, O' , v' , <[, <2), where 

• O' :={xeO \ o<ix} 

• v'{s) :— v{s) if v{s) G O' and v'{s) :— otherwise. 

• <[ is the restrictions of <i to O' . 

• X <2 y ■= X ^ a A {x <2 y V y — o). 



Then every Nash equilibrium of g' is also Nash equilibrium of g. 

Moreover, if the inverse relations of <i and <2 are well-orders, the order types of {<i)^^ and 
(<2)^^ are not greater than those o/(<i)^^ and (<2)^^ respectively. Furthermore, if a is not the 
<i-least element ofO, the order type of {<[)^^ is less than that o/(<i)^^, and if a is the <2-least 
element of infinite O, the order type of (<2)~^ is less than that of (<2)^^- 

Proof Let s be a Nash equilibrium of g' . Since o <i w(e, S2) by assumption about e, the 
outcome w(e, S2) is in O' by definition of O' , so o <'i v'{e,S2) by definitions of v' and <'i. Since 
v'{e,S2) <i v'{s) by definition of NE and since <'i is also strict linear, we have o <'i v'{s), so 
v'{s) e O' — {0} and v{s) = v'{s) by definitions of O' and v' . 

Now let us prove by contradiction that both players are stable w.r.t. s and g. If v{s) <i v{x,S2) 
for some x G S'l, then w(a;, S2) G O' since v{s) G O' and by definition of O', so v'{s) <'i v'{x,S2) 
by definitions of v' and <[, which contradicts s being an NE of g' . If v{s) <2 v{si,y) for some 
y G S2, then i''(s) = o since v'{si,y) <2 v'{s) (by definition of NE) and by definition of <2, which 
is also a contradiction. D 

In some cases of the transfinite-inductive proof of the theorem, Lemma [7] above cannot be 
applied. Then, one may invoke the lemma below, i.e. the contraposition of its bottom-top impli- 
cation. For instance, when no agent is able to exclude their least-preferred outcomes by enforcing 
(finite) sets, i.e sets A and B in Lemma [HI one can built a set C that contradicts Condition [T] of 
Lemma [6] 

Lemma 8 Let / : N^ ^^ N. The following two propositions are equivalent. 

1. There exists a subset of the naturals that intersects each /(n,N) and whose complement 
intersects each f{N,n), where f{n,N) := {f{n,k) \ k G N}. 

2. There exist A and B disjoint subsets of the naturals such that either f{n,N) and A overlap 
or f{n,N)\{AU B) is infinite, and likewise, either f{N,n) and B overlap or f{N,n)\{AU B) 
is infinite. 

The statement is formalised below. 

V/ : N2 ^ N, 
3CCN,VnGN, /(n,N)nC^0 A f{N,n) nN\C ^ (6 

t 
3A,BCN,AnB^(l} A Vn G N, {f{n,N)nA^(ll V \f{n,N)\{AU B)\ ^^q) A 

if{N,n)nB^9 V |/(N,n)\(AUB)| = Ko) 

Proof For the top-bottom implication A := C and B :— N\C witness the claim. To prove the 

bottom-top implication let us define two sequences of subsets of N as follows, by mutual induction. 



^0 

Xn+l 
Yn+1 



= A 

= B 

= Xnli {min{f{n, N)\(X„ U Y,,))} if /(n, N) n A == 0, otherwise X^+i := X„ 

= y„ U {min{f{N, n)\(X„+i U Y,,))} if /(N, n) n B = 0, otherwise y„+i := r„ 



The inductive steps above are well-defined by the assumed disjunctions and since the Xn\A and 
Yn\B are finite by construction. It is provable by induction on n that Xn and Yn are disjoint for 
all n, and so are X := U^o "^" ^^'^ ^ '■~ U^o^"- ^ow note that that C := X witnesses the 
claim since Xn+i (resp. Yn+i) intersects /(n,N) (resp. /(N, n)) by construction. D 



The proof of Theorem [5] starts with a case sphtting on Condition [5] The first case is exactly 
Lemma [HI the second case is reduced to Lemma El and the third case, which involves countably 
many strategies only, is proved by transfinite induction on the preferences and performs nested 
case splits. These case splits are solved either by invoking Lemma [7] and the induction hypothesis, 
or Lemma[5]to contradicts Condition[TJ or by exhibiting a Nash equilibrium in the remaining cases. 
(Note that Theorem [S] proves slightly more than what Section [1] has promised, since it refers to 
finite upper cones instead of finitely many strategies.) 

Theorem 9 (Equilibrium transfer) Let ({1, 2}, 5*1 x S2, O, v, -<i, ^2) be a two-player game in 
normal form, let Ri C ^i and R2 Q S2, and let us assume the following: 

1. VP C O, (3si e i?i, v(suS2) C P) V (3s2 G i?2, v{Si,s2) C 0\P) 

That is, for every subset of outcomes, either player 1 can enforce it via some strategy in Ri 
or player 2 can exclude it via some strategy in R2. 

2. One of the following assertions holds: 

• The preferences are acyclic and one player i can enforce a finite -<i-upper cone. 

• The preferences have finite height. 

• 5*1 and S2 are countable and the inverses of the preferences are well-founded. 

Then the game ({1,2}, 5*1 x 5*2, O, w, ^1, ^2) ho^s a Nash equilibrium in Ri x R2. 
Proof The first case is proved by Lemma HI For the second case, let n e N bound the height of 
both ^1 and ^2, and let pi : O — > {0, . . . , n— 1} and p2 : O — >■ {0, . . . , n — 1} be corresponding rank 
functions, that is, x ^i y implies Pi{x) < Pi{y). Consider the game ({l,2},S'i x 6*2, {0, . . . ,ri — 
1}^, (pi ov,p2 ov), ~<[, ^2) where {i,j) ~<[ {k,l) iS i < k and (i, j) -<2 (^'0 ^^ J < '• By LemmalU 
the derived game has a Nash equilibrium, which happens to be a Nash equilibrium for the original 
game too, by property of pi. 

It suffices to prove the statement for well-ordered preferences. Also note that if one player i can 
enforce a subset of outcome {via some strategy in Si), he/she can enforce it via some strategy in Ri, 
since the opponent cannot exclude it and by assumption (3). Let us define a well-founded binary 
relation over pairs of ordinals, as follows: (a, /3) ^ (7, (5) := (a < 7 A /3 < (5) V (a < 7 A /3 < 6), 
where < is the usual well-order over ordinals, and let us proceed by induction (w.r.t ^) on the 
pairs of order types that correspond to the inverses of the preferences. 

If one order type is finite, it suffices to invoke Lemma [51 so from now on both order types are 
infinite. 

If one player can exclude two or more of his/her least-preferred outcomes. Lemma [7] and the 
induction hypothesis prove the claim, so from now on no player can exclude such a downward 
interval. Especially, at least one order type is not a limit ordinal. 

Let us yet consider the case when one order type, say for player 2, is a limit ordinal. So player 
2 cannot enforce any finite set, otherwise excluding an infinite ^2-downward interval; so player 
1 can enforce some finite set, by assumption (3) and (contraposition of) Lemma [5] instantiated 
with empty A and B. Let xq ^1 ■ • ■ -<i Xn be the n -f 1 least preferred outcomes of player 1. 
Since player 2 cannot enforce {xq, . . . , a;„}, player 1 can exclude it, so n = and the order type of 
(^i)~^ is a limit ordinal plus one. Therefore every finite set that player 1 can enforce contains xq. 
Instantiating (contraposition of) Lemma[8]with A := {xq} and B :— ^ contradicts assumption (3), 
so from now on both order types are not limit ordinals. Let x and y be the ^i-least and ^2-least 
outcomes respectively. 

If players 1 and 2 cannot exclude x and y respectively, by assumption they can enforce y and x 
via some strategies Si and S2 respectively, so x = y and (si, S2) is a Nash equilibrium. From now 
on one player can exclude his/her least preferred outcome, e.g. player 1 can exclude x. 



li X = y, Lemma [7] and the induction hypothesis prove the claim, so from now on x j^ y. 

If player 2 cannot exclude y, player 1 can enforce y via some strategy si (but cannot exclude 
any proper ^i-downward interval), so y is the second -<i-least outcome. Therefore player 2 can 
enforce {x,y} via some strategy S2, and (si,S2) is a Nash equilibrium. From now on player 2 can 
exclude y. 

If y (resp. x) is not the preferred outcome of player 1 (resp. 2), Lemma [7] and the induction 
hypothesis prove the claim. From now on y (resp. x) is the preferred outcome of player 1 (resp. 

2). 

If both order types are limit ordinals plus one, every finite set enforceable by players 1 (resp. 
2) contains x (resp. y). Instantiating (contraposition of) Lemma [8] with A := {x} and B := {y} 
contradicts assumption (3), so from now on one player, e.g., player 1 has a second least-preferred 
outcome z, and z ^ y. 

Player 2 and 1 can enforce {x,z} and the interval [y,z] via some strategies S2 and si, respec- 
tively, so (si, S2) is a Nash equilibrium. D 

3 Applications of the equilibrium-transfer theorem 

Section [01 generalises Martin's Theorem on Borel determinacy, from descriptive set theory, and 
Section 13.21 generalises two determinacy results from theoretical informatics, namely positional 
determinacy of parity games and finite-memory determinacy of Miiller games. 

3.1 Generalisation of Borel Determinacy 

An infinite two-player alternate game consists of two players that play alternately and infinitely 
many times. In addition, the same non-empty set of choices C is available at each stage, so the 
first player picks an element in C, then the second player picks an element in C, then the first 
player picks an element in C again, and so on. The underlying structure of such a game is a leafiess 
and uniform rooted tree. Moreover, each infinite sequence of choices is mapped to some outcome 
and both players have preferences over the outcomes. In a Gale-Stewart game [3] there are two 
outcomes only, each being preferred by one player. 

Definition 10 (Infinite two-player alternate games and strategies) An infinite 2-player al- 
ternate game is an object (C, O, v, -<i, -<2) complying with the following: 



• 



• 



C is a non-empty set (of choices). 

O is a non-empty set (of possible outcomes of the game). 

• V : C" — > O (uses outcomes to value the infinite sequences of choice). 

• ^1 and -<2 are binary relations over O (modelling the preference of player 1 and 2 respec- 
tively). 

A function of type C^* — >■ C (resp. (7^*+^ — >■ C) is a strategy for player 1 (resp. 2). 

A strategy of a player tells what he/she would play at each node of the game. Since the tree 
has a uniform structure, it is convenient to represent a strategy of the first (resp. second) player 
by a function of type C^* -^ C (resp. C'^*+^ -> C), where C^* represents the finite sequences on 
C of even (resp. odd) length. When both players have chosen their individual strategies, their 
combination induces a unique play, i.e. a unique infinite sequence of choices. 



Definition 11 (Induced play) Given a game g = (C, W), and si : C^* -> C, and S2 ■ C^*+^ -^ 
C, let us define p{si,S2) through its prefixes, inductively as below, where p^n is the prefix of p of 
length n and the symbol ■ represents concatenation. 



• P(S1, S2)<2n+1 := P(si, S2)<2n ' Si (p(si , S2) <2n) 

• p(si,S2)<2n+2 :=p(si,S2)<2n+l • S2b(si,S2)<2n+l) 



An infinite two-player alternate game (C, O, v, -<i, -<2) may be translated into a game in normal 
form ({1,2},(C^* -^ C) X ((7^*+^ -^ C), O, w o p, -<i, ^2), which provides the infinite two-player 
alternate game framework with a natural notion of Nash equilibrium. 

Before stating Borel determinacy below, let us recall that a subset of a topological space X is 
called Borel if it belongs to the smallest collection of subsets of X which contains all the open sets 
and is closed under complementation and countable unions. 

Theorem 12 (Martin |7), [§]) Let C be a non-empty set and v : C" — ?> {win, lose} be such 
that v~^{win) is a Borel set of C^ for the product topology. The game below is determined. 
({1,2},(C2* ^ C) X (C2*+i -^ C), {win, lose}, V op, {{lose, win)}, {{win, lose)}). 

The generalisation of Martin's theorem below is a straightforward corollary of both Martin's 
Theorem itself and the equilibrium transfer theorem. 

Corollary 13 Let {C, O, v, -<i, ^2) be an infinite 2-player alternate game and assume the follow- 
ing three conditions. 

• O is countable. 

• <i and ^2 have finite height. 

• For all o E O, the pre-image v^^{o) is Borel. 

Then the game {C,0,v, ^1,^2) ho,s a Nash equilibrium. 

Proof Thanks to the above-mentioned embedding (of alternate games into games in normal 
form) and the finite height assumption, it suffices to check Condition[T]from Theorem[9] Let P C O 
and assume that for all si in C^* — >■ C, there exists S2 in C^*+^ — j. C such that v{si, S2) ^ P- So 
player 1 has no winning strategy for the game ({1, 2}, (C^* — J> C) x (C^*"*"^ — > C), {win, lose}, v o 
p, {{lose, win)}, {{win, lose)}) where v~^{win) := P. Since v{P) is a countable union of Borel sets, 
by assumption, Martin's Theorem implies that player 2 has a winning strategy. So there exists 
S2 in (72*+! _^ (J Qy^cYi that v{si,S2) ^ P for all si in C^* — 7> C, which proves Condition [1] from 
Theorem [9]. D 

3.2 Generalisations on parity games and Miiller games 

These infinite two-agent games are played on graphs. Unfolding these graphs yields infinite trees, so 
Borel determinacy may imply determinacy for these games. However, Borel determinacy does not 
say whether there exist simple winning strategies, or more generally winning strategies satisfying 
some predicate. So, the results that are generalised in Section [22] are not mere corollaries of Borel 
determinacy. The definitions below rephrase, e.g., [4j. 

Definition 14 (Arena and strategy) An arena is an object {V,V' ,E,C,^) complying with the 
following: 

• V is a non-empty set of vertexes. 



• y C y are the vertexes owned by player 1. 

• E <Z V X V are the edges of a sink- free graph, i.e. \fx G V, xE ^ 0. 

• C is a non-empty set of colours. 

• 7 : T^ — )■ C assigns a colour to each of the vertexes. 

A strategy of player 1 (resp. 2) is a function of (dependent) type V^* — > Vw G V , vE (resp. 
V^* — 7- Vv G V\V' , vE). A strategy profile is a function of (dependent) type V^* -^ Vw G V, vE. 
The combination (si, S2) of a strategy si for players 1 and S2 for player 2 amounts to a strategy 
profile, which, when starting from a given vertex, induces a unique infinite sequence of colours 

r(si,s2)ecN. 

Definition 15 (multi-outcome priority/Miiller games) A multi- outcome priority (resp. Miiller) 
game is an object {Q, O, e, -<i, -<2) complying with the following: 

• Q is an arena where C — "H (resp. finite arena) as defined above. 

• O is a non empty set of outcomes. 

• e : N U {_L} ^ O (resp. e : r{C) -^ O) 

• -<i and ^2 a^e binary relations over O, the preferences. 

For every infinite sequence of colours V, let cl(T) be its cluster set, i.e. the set of the colours 
occurring infinitely often in T. The outcome induced by a sequence of colours T G C^ , i.e. by a 
strategy profile and a starting vertex, is: 

• For Miiller, e o cl(T). 

• For priority, e o min o cl{T) if cl{T) ^ 0, otherwise e(_L). 

Note that setting O := {win, lose} and lose ^1 win and win -<2 lose (plus e(2n) :— e{l.) :— 
win and e(2n + l) := lose for a multi-outcome priority game) in the definition above yields a parity 
(resp. Miiller) game, "up to isomorphism". 

It was proved in [S] that Miiller games are determined through finite-memory strategies and 
in [3] that parity games with priorities in N are positionally determined. Since these are determi- 
nacy results, let us extend them to multi-outcome settings below. (Note that one need not know 
what positional or finite-memory means.) 

Corollary 16 Every multi-outcome Miiller game (initiated with a starting vertex) with acyclic 
preferences has a finite-memory Nash equilibrium. 

Proof Let {V, V , E, C, 7, O, e, ^1, ^2) be a multi-outcome Miiller game with acyclic preferences, 
and let vq G V he the starting vertex. Since it is naturally embedded into a game in normal form 
(as far as NE are concerned), it suffices to invoke Lemma |6] to prove the claim, where Conditions [2] 
and [3] are fulfilled by assumption and finiteness of the game respectively. Let us prove below that 
Condition [T] is also fulfilled. 

Let P C_ O and assume that eoclor{si, S2) ^ P for all si in Ri, the finite-memory strategies of 
player 1. Let {V, V , E, C, 7, {win, lose}, e', {{lose, win)}, {{win, lose)}) be a derived Miiller game 
(starting with vq) where e'{F) := win iff e{F) G P. Let us rephrase the above assumption: 
e' o cl o T{si, S2) ^ {win} for all si in Ri, that is, player 1 has no winning strategy in the derived 
game, so by J5 player 2 has a winning strategy in R2, the finite-memory strategies of player 2. So 
let S2 be in R2 such that e'odor(si, S2) = lose for all si in Ri, therefore eocloT{Si, S2) C 0\P. D 



10 



Corollary 17 Every multi- outcome priority game where preferences have finite height has a po- 
sitional Nash equilibrium. 

Proof Let {V, V , E, N, 7, O, e, ^1, ^2) be a multi-outcome priority game where the preferences 
have finite height, and let uq € V' be the starting vertex. Since it is naturally embedded into a 
game in normal form (as far as NE are concerned), and thanks to the finite height assumption, it 
suffices to check Condition [T] from Theorem IH] to prove the claim. 

Let P C O and assume that e(_L) G P. (If not, swap players 1 and 2 and subsets P and 
0\P in the remainder of the proof.) Let us further assume that for all si in Ri, the positional 
strategies of player 1, there exists S2 in S2, the strategies of player 2, such that d o r(si, S2) ^ 
and eo77iznodor(si, S2) ^ P- Let {V, V , E,C,Yj {win, lose}, e, {{lose, win)}, {{win, lose)}) be a 
derived priority game (starting with vq) where "/'{v) := 2^{v) if eo"f{v) e P and Y{v) := 2"f{v) + 1 
if e o 7(ii) ^ P, which yields a new function V from strategy profiles to infinite sequences of 
naturals. Let us rephrase the above assumption: for all si in Ri, there exists S2 in S2 such that 
cl o r'(si, S2) 7^ and e o min o cl o T'{si, S2) = lose, that is, player 1 has no winning strategy in 
the derived game, so by [4] player 2 has a winning strategy in i?2. So let S2 be in R2 such that 
e o min o cl o T'{si, S2) = lose for all si in Ri, therefore e o min o cl o T{Si, S2) C 0\P. D 

Unfortunately I could not invoke in Corollary [T7] the countable- well- founded version of Theo- 
rem [5] since I do not know whether the winning strategy from 4 can always be chosen in a given 
countable set, e.g. whether a computable winning strategy always exists. 

4 Limitations of transfer possibilities 

Proposition \TE\ below shows that Condition [2] of Theorem [5] is difficult to weaken in general, then 
Proposition [201 rules out a reasonable three-player version of equilibrium transfer. 

In the game below, one preference has finite height (but not both preferences, otherwise equilib- 
rium transfer would hold), the other preference has well-founded inverse, one player has countably 
many strategies (but not both players, otherwise equilibrium transfer would hold), but equilibrium 
transfer does not hold. 

Proposition 18 Let I (resp. C) be the infinite (resp. cofinite) subsets of the naturals. Consider 
the game in normal form ({1, 2}, (CU {a, f3}) x (/U {a, /3}), NU {a, b}, v, ^1, -<2) where -<i a and 
b -<i a and n -|- 1 ^1 n for all n € N, and a ~<2 b and n ^2 b for all n G N, and where v is as below 
and min refers to the usual order over N. 

v. {C U {a, 13}) X {I U {a, P}) -^ NU {a,b} 

{X,Y) ^ a ifX^Ye{a,f3} 

b if{X,Y} = {a,l3} 

min{X) if{X,Y)eCx{a,(3} 

min{Y) if {X, Y) e {a, 13} x I 

min{XnY -{minXnY}) if X,Y (^ {a, (3} 

The game has no Nash equilibrium although the following formula holds: 
VP C N U {a, b}, (3si e Si, v{si,S2) C P) V (3s2 e ^2, v{Si,.S2) C 0\P) 
Also, the result still holds when swapping I and C . 

Proof First, let P C N U {a,b}. If P n N is cofinite, player 1 can enforce it (by playing it) 
since v{X, Y) is in X for all X e C and F e / U {a, /3}, by definition of v; so a fortiori player 1 
can enforce P. If P n N is not cofinite, N\P is infinite, so player 2 can enforce it, and a fortiori 
(NU{a,6})\P. 

Second, let us show below that the game has no Nash equilibrium. 

• v{a,a) <2 v{a, j3) and v{f3,/3) <2 v{f3,a). 
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• v{a, /3) <i w(/3, /3) and w(/3, a) <i v{a, a). 

• If X e C and r e {a, 13} then i;(X, F) <i v{Y, Y) = a. 

• If X e {a, /?} and ye/ then v{X, Y) <2 v(X, X') = b, where {X, X'} = {a, /?}. 

• If X, F ^ {a, /3} then ^;(X, F) <i v{a, Y) shice min{X nY - {riiinX n F}) < min{Y). 



n 



The equihbrium-transfer theorem considers two-player games only, which raises the issue of the 
existence of a three-player version of the theorem. The determinacy condition of the equilibrium- 
transfer theorem, i.e. Condition [T] of Theorem [31 may be rephrased using maps from the set of 
outcomes of the original game into the set of outcomes {(1, 0), (0, 1)}. In the case of three players, 
a natural extension of this condition would require existence of Nash equilibrium when arbitrarily 
mapping the set of outcomes of the original game into, e.g., the set {(1, 0, 0), (0, 1, 0), (0, 0, 1)}. A 
stronger condition, i.e. more likely to lead to a three-player version of the equilibrium-transfer 
theorem, would map the outcomes into {0, 1}'^. Even stronger conditions would map the outcomes 
into {0,1,2, .. .n}^ for some n > 2. Nonetheless, even the last and strongest condition fails to guar- 
antee equilibrium transfer. The remark below proves the simpler case {0, 1}'^ and Proposition!^ 
afterwards generalises it to {0, 1, 2, . . .n}^. 

Remark 19 Let a, b and c be three players, let I and r be two available strategies, let x, y and z 
be three possible outcomes, define three transitive preferences through z <a y <a x and x <b y <b z 
and <c'-—<b, o-nd define an outcome function as follows: v(l,l,l) = v{l,r,l) = v{r,l,l) := y and 
v{r,r,l) = v{l,l,r) = v{l,r,r) := z and v{r,l,r) = v(r,r,r) = x. See the graphical representation 
below, where one of players a, b, and c choosing I yields top row, left columns, and left array 
respectively. 



y 


y 




z 


z 


z 


y 


X 


X 



• The game ({a, &, c}, {/, r}'^, {x, y, z}, u, (<rf)£;g{i 2,3}) has no Nash equilibrium. 

• Let {0,1}"^ be an alternative set of outcomes and for i,j,k,n G {0,1} let (0, i,j) -<a {l,k,n) 
and {i,0,j) ^f, (fc, l,n) and {i,j, 0) -<c (k,n, 1). Then for all f : {x, y, z} — > {0, 1}^ the game 
{{a, b, c}, {I, r}^, {0, 1}^, f ov, (-<d)de{a,b,c}) has a Nash equilibrium. 

Proof The original game has no Nash equilibrium, by construction. Let / : {x,y,z} -^ {0, 1}^ 
and from now on let us consider the modified game only, assume that it has no Nash equilibrium, 
and draw a contradiction. Both players a and b are stable w.r.t. the strategy profile (1,1,1) since 
v{l, I, I) — v(l, r, I) — vir, 1,1) — y by construction, so fijj) ~ f o v{l, I, I) ^c f ° v{l, I, r) = f{z). So 
player c is stable w.r.t. the strategy profile {I, I, r), and so is player b since v{l, I, r) — v{l, r, r) = z, 
therefore f{z) = f ov{l,l,r) -<a f ° v{r, I, r) — f{x). So player a is stable w.r.t. the strategy profile 
(r, r, r), and so is player b since v{r, I, r) — v{r, r, r) = x, so f{x) — fov{r, r, r) -<c f°v{r, r, I) = f{y). 
Therefore f{x) -<c f{y) ^c f{z), contradiction since -<c has no chain of length 2. D 

Proposition 20 For every natural 2 < n there exists a finite three-player game in normal form 
that complies with the following: 

• The preferences are linear orders. 

• The game has no Nash equilibrium. 

• Replacing the preferences with preferences that have no chain of length n yields a game with 
a Nash equilibrium. 
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Proof Let 2 < n be a natural, let <b and <c be the restrictions of the usual order over the 
naturals to {0, . . . , n}, and let <a:=<^ , that is, n <a n — 1 <a • ■ • <a 1 <a 0. Let us define the 
outcome function v : {1, . . . , n}^ — > {0, . . . ,n} below. 

• For 1 < « < n let v{n, i, n) :— 0. 

• For 1 < z < n let v{i, i, n) := i + 1. 

• Otherwise let w(-, -^n) return n. 

• For 1 < i < n let f (n, 1, i) :— n. 

• For 1 <i < n and I < j < n let v(i,j,i) := v{j,i,i) := i. 

• Otherwise let v return 1. 

The game ({a, b, c}, {1, 2, 3, 4}'^, {0, 1, 2, 3, 4}, w, {<d)de{a.b,c}} is represented below, where player a 
chooses the row, b the column, and c the array. 
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Let us show that the game {{a,b,c},{l, . . . ,n}^, {0, . . . ,n},v,{<d)de{a.b,c}) witnesses the claim. 
First, the preferences are linear orders indeed. Second, let us show that there is no Nash equilibrium 
by case-splitting below. 

• If i, fc ^ n, then v{i,j, k) <c v{i, j, n). 

• li i ^ n, then v(i, j, n) <„ — v{n,j, n). 

• v{n,j,n) =0 <c v{n,j,l). 

• v{n, 1, 1) = n ^a 1 = v{l, 1, 1) and if j =/= 1, then v{n, j, 1) — 1 -<;, n = v{n, 1, 1). 

• If J 7^ 1 and 1 < fc < n, then v{n,j, k) <i, n — v{n, 1, k). 

• If 1 < fc < n, then v{n, l,k) ~ n <„ 1 — w(l, 1, k). 

Third by contraposition, let <a, "<6 and -<c be arbitrary acyclic preferences, assume that the game 
({a, 6, c}, {1, . . . , n}^, {0, . . . , n}, w, (^d)de{i,2,3}) has no Nash equilibrium, and let us prove that 
~<c~<c, thus contradicting the assumption on the chains. If i ^ n, by construction v{i,i,i) = i = 
v{j, i, i) — v{i, j, i) and w(i, i, j) G {1, i, i + 1}. By assumption there is no Nash equilibrium and the 
preferences are acyclic, so i ^c 1 or i ^c « + ! if 1 ^ * < 't-, so 1 -<c 2, and it is provable by induction 
that I ^c « + 1 for all 1 < i < n. Now it suffices to prove ^c 1 to conclude. By assumption the 
strategy profile (n — 1, n, n) is not a Nash equilibrium, so v{n — 1, n, n) — n -<a — v{n, n, n) since 
w(i, n, n) = v{n — 1, j, n) — n for i ^ n, since v(n — 1, n, k) G {1, n — 1, n}, and by assumption of 
acyclic preferences. Now, the profile (n, n, n) is not a Nash equilibrium either. Since w(ri, j, n) = 0, 
since v{i, n,n) — n\ii ^ n, and since n -<a 0, the players a and 6 are sable. Since w(n, n, fc) E {0, 1}, 
we must have w(n, n, n) = ^c 1- D 
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In addition to strengthening the determinacy condition to obtain a three-player version of the 
equihbrium-transfer theorem, one may also require a zero-sum condition on the preferences, since 
transfer of equilibrium is easier to prove for zero-sum games. However, defining z{n) := (— 2?i, n, n) 
and using the outcome function z o v instead of v for the game in the proof of Proposition 1201 
above yields a zero-sum game that is also a counterexample to the weakest three-player version of 
equilibrium transfer. 

5 Conclusion 

This article has shown that every determinacy result over a given game structure is transferable 
into existence of multi-outcome Nash equilibrium over the same game structure in three cases: 
when one player can enforce a finite upper cone of outcomes, or when both preferences have finite 
height, or when strategies are countable and preferences have well-founded inverses. As examples 
of application of the equilibrium-transfer theorem, Borel determinacy, finite-memory determinacy 
of Miiller games, and positional determinacy of parity games have been generalised. In each case, 
the application involves the design of a multi-outcome version of the determined games, and some 
reasonable bookkeeping is required to check Condition [T] of Theorem [5] since the games at hand 
are not in normal form. The three examples are meant to give an idea of the various possible 
applications of the theorem: the first example comes from descriptive set theory, the others from 
theoretical informatics; the first example does not use any additional predicate, the second example 
discriminates finite-memory strategies, and the third example discriminates positional strategies; 
unfortunately all examples involve finite-height preferences only. 

Unexpectedly, the finite-height condition of Theorem [S] leads to an interesting phenomenon 
about preferences: linear orders do not account for partial orders. Indeed the remark below 
considers two finite-height preferences, therefore fulfilling Condition [2] of Theorem [9l yet for all 
possible linear extensions of these preferences, equilibrium transfer does not hold! 

Remark 21 Let ~<i and -<2 be two binary relations over N that are defined by 2n ^i 2n + I and 
-<2:=^j~ . For all <i and <2 linear extensions of <i and -<2 respectively, there exists a game 
satisfying Condition [7] of Theorem O but without Nash equilibrium. 

Proof If the inverse of <i is not a well-order, the game {{i}, N, N, id, <i) has no Nash equilibrium 
although determinacy holds, so let us assume that the inverses of <i and <2 are well-orders. 
Since the sequence (2n)„gN has no <i-increasing subsequence, it has a <i-decreasing subsequence 
{2(f)(n))neN (as a consequence of Ramsey Theorem). Since the sequence (2(j){n))neN has has no <2- 
increasing subsequence, it a <2-decreasing subsequence (20of/;(n))„gN- By setting a := 20o'0(O)-)-l 
and b := 2(f) o -0(0) and Xn — 2(j) o %p{n ~\- 1), we obtain a preference structure that includes the one 
from Proposition 1181 so the game built therein witnesses also for the remark at hand. D 

Nonetheless, it is often very convenient to consider linearly ordered preferences only, when 
actually done without loss of generality. The remark above just exemplifies that one ought to be 
very cautious because a loss of generality may occur. 
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